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Noise recovery for Levy-driven CARMA processes and 
high-frequency behaviour of approximating Riemann sums 
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Abstract 

We consider high-frequency sampled continuous-time autoregressive moving average 
(CARMA) models driven by finite-variance zero-mean Levy processes. An Inconsistent es- 
timator for the increments of the driving Levy process without order selection in advance is 
proposed if the CARMA model is invertible. In the second part we analyse the high-frequency 
behaviour of approximating Riemann sum processes, which represent a natural way to sim- 
ulate continuous-time moving average processes on a discrete grid. We shall compare their 
autocovariance structure with the one of sampled CARMA processes, where the rule of in- 
tegration plays a crucial role. Moreover, new insight into the kernel estimation procedure of 



Brockwell et al. (2012a I is given 
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1 Introduction 

The constantly increasing availability of high-frequency data in finance and sciences in general 
has sparked in the last decade a great deal of attention about the asymptotic behaviour of high- 
frequency sampled processes, especially concerning the estimation of the multi-power variations 



of Ito semimartingales (see, e.g., Andersen and Todorov (2010), Barndorff-Nielsen and Shephard 



(2003)), employing their realized counterparts. These quantities are of primary importance to 



practitioners, since they embody the deviation of data from a Brownian motion. Such methods 



are summarized in the book of Jacod and Protter (2012) and references therein, which represents 



the most recent review on the subject. 
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In many areas of application Levy-driven processes are used for modelling time series. An 
ample class within this group are continuous-time moving average (CMA) processes 



Yt 



g(t - s)dL s , t G 



(1.1) 



where g is a so-called kernel function and L = {Lt}t<=K. is sa id to be the driving Levy process 
(see, e.g., Sato (1999) for a detailed introduction). They cover, for instance, Ornstein-Uhlenbeck 



and continuous-time autoregressive moving average (CARMA) processes. The latter are the 
continuous-time analog of the well-known ARMA processes (see, e.g., Brockwell and Davis 



(1991)) and have been extensively studied over the recent years (cf. Brockwell (2001 2004); 



Brockwell and Lindner (2009); Todorov and Tauchen| ( 2006 ) ) . Originally, driving processes of 



CARMA models were restricted to Brownian motion (see Doob (1944), and also Doob (1990)); 



however, Brockwell (2001) allowed for Levy processes with a finite rth moment for some r > 0. 



Levy-driven CARMA processes are widely used in various areas of application like signal 



processing and control (cf. Gamier and Wang (2008); Larsson et al. (2006)), high-frequency 
financial econometrics (cf. Todorov (2009)) and financial mathematics (cf. Benth et al. (2010); 



Brockwell et al. ( 2006 ) ; |Haug and Czado (2007); Todorov and Tauchen (2006)). Stable CARMA 



processes can be relevant in modelling energy markets (cf. Benth et al. (2011); Garcia et al 



(2011)). Very often, a correct specification of the driving Levy process is of primary importance 



in all these applications. 

In this paper we will be concerned with a high-frequency sampled CARMA process driven 
by a second-order zero-mean Levy process. Under the assumption of invertibility of the CARMA 
model, we shall present an L 2 -consistent estimator for the increments of the driving Levy process, 
employing standard time-series techniques. It is remarkable that the proposed procedure works 
for arbitrary autoregressive and moving average orders, i.e. there is no need for order selection 



in advance. In the light of the results in Brockwell et al. (2012a) and the flexibility of CARMA 



processes, the method might apply to a wider class of CMA processes, too. Moreover, since the 
proof employes only the fact that the increments of the Levy process are orthogonal rather than 
independent, the result holds for a much ampler class of driving processes. Notable examples are 



the COG ARCH processes (Brockwell et al. (2006); Kluppelberg et al. (2004)) or time-changed 



Levy processes (Carr et al. (2003)), which are often employed to model volatility clustering in 
finance and intermittency in turbulence. 

This noise recovery result will give rise to the conjecture that the sampled CARMA process 
behaves on a high-frequency time grid approximately like a suitable MA(oo) process, which 
we shall call approximating Riemann sum process. By comparing the asymptotic properties of 
the autocovariance structure of high-frequency sampled CARMA models with the one of their 
approximation Riemann sum processes, it will turn out that the so-called rule of the Riemann 
sums plays a crucial role if the difference between the autoregressive and moving average order is 
greater than 1. On the one hand, this gives new insight for the kernel estimation procedure studied 
in Brockwell et al. (2012a) and explains at which points the kernel is indeed estimated. On the 



other hand, this has obvious consequences for simulation purposes. Riemann sum approximations 
are an easy tool to simulate CMA processes; however, our results show that one has to be careful 
with the chosen rule of integration in the context of certain CARMA processes. 

The outline of the paper is as follows. In Chapter [2] we are going to recall the definition of 
finite-variance CARMA models and summarise important properties of high-frequency sampled 
CARMA processes. In particular, we fix a global assumption that guarantees causality and 
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invertibility for the sampled sequence. In the third chapter we then derive an L 2 -consistent 
estimator for the increments of the driving Levy process starting from the Wold representation 
of the sampled process. It will turn out that invertibility of the original continuous-time process is 
sufficient and necessary for the recovery result to hold. Chapter [3] is completed by an illustrating 
example for CAR(2) and CARMA(2, 1) processes. Thereafter, the high-frequency behaviour of 
approximating Riemann sum processes is studied in Chapter [4] First, an ARMA representation 
for the Riemann sum approximation is established in general and then the role of the rule of 
integration is analysed by matching the asymptotic autocovariance structure of sampled CARMA 
processes and their Riemann sum approximations in the cases where the autoregressive order 
is less or equal to 3. The connection between the Wold representation and the approximating 
Riemann sum yields a deeper insight into the kernel estimation procedure introduced in Brockwell 



et al. (2012a I . A short conclusion can be found in Chapter [5] and some auxiliary results are 



established in the appendix. 

2 Preliminaries 

2.1 Finite-variance CARMA processes 

Throughout this paper we shall be concerned with a CARMA process driven by a second-order 
zero-mean Levy process L = {Lt}teR with EL\ = and EL\ = 1. It is defined as follows. 

For non-negative integers p and q such that q < p, a CARMA(jj, q) process Y = {l^jtgR 
with coefficients a±, . . . , a p , bo, . . . ,b q E M and driving Levy process L is defined to be a strictly 
stationary solution of the suitably interpreted formal equation 

a(D)Y t = ab(D)DL t , t E K, (2.1) 

where D denotes differentiation with respect to t, a(-) and &(•) are the characteristic polynomials, 

a(z) := z p + a\z v ~ x + ■ ■ ■ + a p and b(z) := 6o + b\Z + • • • + b p ^±z p ~ , 

the coefficients bj satisfy b q = 1 and bj = for q < j < p, and a > is a constant. The 
polynomials a(-) and &(•) are assumed to have no common zeroes. Throughout this paper we 
shall denote by Aj, i = 1, . . . ,p, and — //j, i = 1, . . . , q, the roots of a(-) and &(•) respectively, 
such that these polynomials can be written as a(z) = nf=i( z — ^i) anc ^ b(z) = Y\i=i( z + A 4 ?)- 
Throughout this paper we will further assume 

Assumption 1. (i) The zeroes of the polynomial a(-) satisfy K(Aj) < for every j = 1, . . . ,p, 
(ii) the roots of &(•) have non-vanishing real part, i.e. 3?(//j) ^ for all j = 1, . . . , q. 



Since the derivative DLt does not exist in the usual sense, we interpret (2.1) as being equiv- 
alent to the observation and state equations 

Y t = b T X t , (2.2) 

(TK t = AX t dt + e p dL t , (2.3) 
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where 
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and A = —ax for p = 1. 



It is easy to check that the eigenvalues of the matrix A are the same as the zeroes of the 
autoregressive polynomial a(-). 

Under Assumption [T] (i) it has been shown in (Brockwell and Lindner (2009), Theorem 3.3) 
that Eqs. (2.2)-(2.3) have the unique strictly stationary solution, 



/oo 
g(t - u)dL u , t £ R, 
-oo 



where 



g(t) 



a(z) 



0. 



if t > 0, 



if t < 0, 



(2.4) 



(2.5) 



and p is any simple closed curve in the open left half of the complex plane encircling the zeroes 
of a(-). The sum is over the distinct zeroes A of a(-) and Res z= \(-) denotes the residue at A 



of the function in brackets. The kernel g can also be expressed (Brockwell and Lindner (2009) 
equations (2.10) and (3.7)) as 



g(t) = ab T e Ai e p l (0jOo) (t), t€ 



and its Fourier transform is 



F{9(-)}(", 



:= [ g( S y 
JR 



s ds 



a 



b(—iu) 
a(—iuj) 



(2.6) 



(2.7) 



In the light of Eqs. (2.4)-(2.7), we can interpret a CARMA process as a continuous-time filtered 



white noise, whose transfer function has a finite number of poles and zeros. We outline that the 
request on the roots of a{ ) to lie in the interior of the left half of the complex plane in order 



to have causality arises from Theorem V, p. 8, Paley and Wiener (1934), which is intrinsically 



connected with the Theorems in Titchmarsh (1948), pp. 125-129, on the Hilbert transform. A 



similar request on the roots of &(•) will turn out to be necessary for recovering the driving Levy 
process. 



2.2 Properties of high-frequency sampled CARMA processes 

We now recall some properties of the sampled process Y A := {Y nA } neId of a CARMA (p, q) 
process where A > 0; cf. Brockwell et al. ( 2012a|b ) and references therein. It is known that the 
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sampled process Y A satisfies the ARMA(p, p — 1) equations 

$a(b)Y* = Qa(B)Z*, neZ, {Z a }~WN(0,<t|), 



(2. 



with the AR part &a(B) := nf =1 (l — e^ Xi B), where B is the discrete-time backshift operator, 
BY^ := Y*_ v Finally, the MA part 6 A (0 is a polynomial of order p — 1, chosen in such a 
way that it has no roots inside the unit circle. For p > 3 and fixed A > there is no explicit 
expression for the coefficients of Ga(') nor the white noise process Z^. Nonetheless, asymptotic 
expressions for 0a(") an d o\ = var (Z A ) as A I were obtained in |Brockwell et al.| (|2012a|b[). 
Namely we have that the polynomial Qa( z ) can be written as (see Theorem 2.1, Brockwell et al. 



(2012a)) 



p-q-l q 

@a(z)= n (1 + ^)[[(1-C4 ^eC, 

i=i 

a 2 A 2{p- q )-l 



(2( P -g)-i)!n£r 1 ^) 



(l + o(l)), asA|0, 



where, again as A \, 0, 



(2.9) 
(2.10) 



Ck = l±MfcA + o(A), 
77(6) = & - 1 ± - I) 2 - 1 + o(l) 



fe = 1, 



g-1. 



(2.11) 



The signs ± in (2.11) are chosen respectively such that, for sufficiently small A, the coefficients 



Cfc and rj(£i) are less than 1 in absolute value, to ensure that Eq. (2.8) is invertible. Moreover, £j, 
i = 1, . . . ,p — q — 1, are the zeros of a p _ (? _i(-), which is defined as the (p — q — l)-th coefficient 
in the series expansion 



sinh(2:) 
cosh(z) — 1 + x 



^a fe (x)z 2fc+1 , z£C, x £ M\{0}, 



(2.12) 



k=0 



where the L.H.S. of Eq. (2.12) is a power transfer function arising from the sampling procedure 

1, can be 



(cf. Brockwell et al. (2012b), Eq. (11)). Therefore the coefficients 77(6 



1, 



,p-q- 



regarded as spurious, as they do not depend on the parameters of the underlying continuous-time 
process Y, but just on p — q. 

Remark 2.1. Our notion of sampled process is a weak one, since we only require that the sampled 
process has the same autocovariance structure as the continuous-time process, when observed on 



a discrete grid. We know that the filtered process on the LHS of (2.8) (Brockwell and Lindner 



(2009), Lemma 2.1) is a (p — \)-dependent discrete-time process. Therefore there exist 2 P 



possible representations for the RHS of (2.8) yielding the same autocovariance function of the 



filtered process, but only one having its roots outside the unit circle, which is called minimum- 



phase spectral factor (see Sayed and Kailath (2001) for a review on the topic). Since it is not 
possible to discriminate between them, we always take the minimum-phase spectral factor without 
any further question. This will be crucial in our main result. 

Moreover, the rationale behind Assumption [7] (ii) becomes clear now: if = for some 

k, then the corresponding \C,k\ 2 is equal to 1 + A 2 |/i&| 2 + o(A 2 ), for either sign choice. Then the 
MA(p — 1) polynomial in Eq. (|2.9|) will never be invertible for small A. 
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In order to ensure that the sampled CARMA process is invertible, we need to verify that 
I 1 ? (£01 wm b e strictly less than 1 for all i = 1, . . . ,p — q — 1 and sufficiently small A. 



Proposition 2.2. The coefficients r)(£i) in Eq. (2.11 ) are uniquely determined by 

ri(Zi) = 6 - 1 - V(Ci - l) 2 - 1 + o(l), i = 1, . . . ,p - q - 1, 
and we have that £j — 1 — \J (£j — l) 2 — 1 6 (0, 1) for all i = 1, . . . ,p — q — 1. 



Proof. It follows from Proposition A.l that £j 6 (2, oo) for all i = 1, . . . ,p — q — 1. This yields 
£i — 1 + y/ (£j — l) 2 — 1 > 1 for all i and hence, we have that 



V(Ci) = 6 - 1 - -1) 2 -1 + 0(1), 



l,...,p-g- 1. 



Since the first-order term of ??(£j) is positive and monotonously decreasing in £j, the additional 
claim follows. □ 



3 Noise recovery 

In this section we are going to prove the first main statement of the paper, which is a recovery 
result for the driving Levy process. We start with some motivation for our approach. 

We know that the sampled CARMA process Y A = {l^Ajnez h as the Wold representation 



(cf. Brockwell and Davis (1991), p. 187) 



3=0 




n £ 



(3.1) 



where Yl^oi^j^) 2 ^ 00 • Moreover, Eq. (3.1) is the causal representation of Eq. (2.8), and it 



has been shown in Brockwell et al. (2012a) that for every causal and invertible CARMA(p, q) 
process, as A ^ 0, 

^tt/A\^9(t), t>0, (3.2) 



where g is the kernel in the moving average representation (2.4). Given the availability of classical 
time-series methods to estimate and a\, and the flexibility of CARMA processes, we 

argue that this result can be applied to more general continuous-time moving average processes. 



Given Eqs. (3.1) and (3.2) it is natural to investigate, whether the quantity 



O-A 



Zt 



n G 



approximates the increments of the driving Levy process in the sense that for every fixed t G 
(0,oo), 

[t/AJ 2 

Y,L?^L t , A |0. (3.3) 



As usual, convergence in L 2 implies also convergence in probability and distribution. 
The first results on retrieving the increments of L were given in 



and furthermore generalized to the multivariate case by Brockwell and Schlemm (2011). The 
essential limitation of this parametric method is that it might not be robust with respect to 



Brockwell et al. 



2011) 



model misspecification. More precisely, the fact that a CARMA(p, q) process is (p — q— l)-times 



to work (cf. Theorem 4.3 of Brockwell and Schlemm 



differentiable (see Proposition 3.32 of Marquardt and Stelzer (2007)) is essential for the procedure 



(2011 1). However, if the underlying process 



is instead CAKM.A(p' , q') with p' — q' < p — q, then some of the necessary derivatives do not 
longer exist. In contrast to the aforementioned procedure, in the method we propose there is no 
need to specify the autoregressive and the moving average orders p and q in advance. 



Before we start to prove the recovery result in Eq. (3.3), let us, in analogy to the discrete-time 
case, establish the notion of invertibility. 

Definition 3.1. A CARMA(p, q) process is said to be invertible if the roots of the moving average 
polynomial &(•) have negative real parts, i.e. ^t(m) > for all % = 1, . . . , q. 

Our main theorem is the following: 

Theorem 3.2. Let Y be a finite-variance CARMAfp, q) process and Z A the noise on the RHS 
of the sampled Eq. (2.8). Moreover, let Assumptionlnhold and define Z A := y/A/ 'a^Z^ . Then, 
as A |0, 

It/A] 

■ A L 2 



Y^Lf^Lt, t€(0,oo), 



(3.4) 



i=i 



if and only if the roots of the moving average polynomial &(•) on the RHS of the CARMA Eq. ( 2.1 ) 
have negative real parts, i.e. if and only if the CARMA process is invertible. 



Proof. Under Assumption [T] (ii) and using Proposition 2.2 the sampled ARMA equation (2.8) 
is invertible. The noise on the RHS of Eq. (2.8) is then obtained using the classical inversion 
formula 



Zi 



Mg) y A 

&a(B) n ' 



where B is the usual backshift operator. Let us consider the stationary continuous-time process 



$a(#a) 
@a(B a ) 



Y f 



i=0 



t— iA 



g(t — iA — s)dL s , t G 



(3.5) 



where the continuous-time backshift operator Ba is defined such that -Ba^ := Yf-A f° r every 
t £ M. and the series in the RHS of Eq. (3.5) is the Laurent expansion of the rational function 



^a(-)©a 1 ( - )- Moreover, Z^ A = Z^ for every n G N; as a consequence, the random variables 
Z^, Z^ are uncorrelated for \t — s\ > A and vai(Z^) = var(Z A ). Exchanging the sum and the 
integral signs in Eq. (3.5), and the fact that g(-) = for negative arguments, we have that Z^ 



is a continuous-time moving average process 



= f g A (t - s)dL s , t 



whose kernel function g has Fourier transform (cf. Eq. (12/7 



^ ( p iujA\ 



a 



$ A (e JwA ) 6(-tw) 
6 A (e iwA ) a{-iu)' 



u G 



A > 0. 
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Since we can write Lt — Lt-A = JL^ l(o,A)(* — s)dL s , t £ R, the sum of the differences 
between the rescaled sampled noise terms and the increments of the Levy process is given by 



E#-a*=/ E 

3=1 J -°° 3=1 



where, for every n G N, 

n 

h*(s) := E 
3=1 



A 

0"A 



g A (jA-s)-l {0A) (jA-s) 



dL, 



nA 



h n (nA — s)dL s , 



(3.6) 



A 

<7A 



g A (s + (j - n)A) - l (0 ,A)(s + U ~ n)A) 



and the stochastic integral in Eq. (3.6) w.r.t. L is still in the L -sense. It is a standard result, cf. 
(Gikhman and Skorokhod, 2004, Ch. IV, §4), that the variance of the moving average process in 
Eq. (3.6) is given by 



E 



E L f - L nA 

3=1 



nA 



[h A (nA-s)) ds = \\h A (- 



lL 2 > 



(3.7) 



where the latter equality is true since h A (s) = for any s < 0. 

Furthermore, the Fourier transform of h A (-) can be readily calculated, invoking the linearity 
and the shift property of the Fourier transform. We thus obtain 



0"A 



^{ 5 A (.)}H--F{i (0 ,A)(-)}H 



E< 

3=1 



,iuj(n-j)A 



An-=i(l-e A( ^ + ^)6(-^) e^ A -l 



£j A 0A(e mA ) a(-iuj) iuj 

=: [/i A 'V) - h A ' 2 {uj)] ■ h A ^{oo), u£R. 
Due to Plancherel's Theorem, we deduce 



1 - e 1 



j An 



1 - e 



iajA 



var 



E L f _L " z 



i=l 
1 

" 2^ 



1 

2tt 



/a 1 • + \h A > 2 ■ c ,3 (w)r - 2K • /iA,2 (^) ) K ,3 Mr ^- ( 3 - § ) 



,A,2 , A,3 



,A,1 



,A,3/ 



It is easy to see that the first two integrals in Eq. (3.8 ) are, respectively, the variances of Y^i=i 
and L„a, both equal to nA. Setting n := [t/ AJ yields for fixed positive t, as A J, 0, 



var 



[t/AJ 



E L t ~ L U/AJA 



i=l 



2 [t/A\ A 



7T 



du 



2t(l + o(l)) - l -Jjl(h A > 1 ■ h**{uj) |^/ 3 AJ (^) 



Thus, in order to show Eq. (3.4), it remains to prove that 



^ R^/A^/A 2 ^)) |/i A ^ 3 AJ (u;)| 2 da; = 2t(l + o(l)) as A | 0, 
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which in turn is equivalent to 



1 

2vr7 



a 



w I 6 A (e^ A ) a(-iw) 



A 1 - cos(w|_i/AJA) 
a A 1 — cos(wA) 

1 - cos(a;A) 9 fll?=i(l " e A(A ^) b(-iu) 



+ 



G A (e 



a[—iuj) 



dw = l + o(l) as A | 0. (3.9) 



Now, Lemma A.2| shows that the integrand in Eq. (3.9) converges pointwise, for every oj 6 
M\{0}, to 2(1 - cos(wt))/a; 2 as A | 0. Since, for sufficiently small A, the integrand is dominated 
by an integrable function (see Lemma A. 3), we can apply Lebesgue's Dominated Convergence 
Theorem and deduce that the LHS of Eq. (3.9) converges, as A \, 0, to 



1 f 1 - cos(ut) , 2 
— / du = - 



1 — cos(u;, 



dui = 1. 



This proves Eq. (3.9) and concludes the proof of the "if -statement. 

As to the "only if'-statement, let J := {j = 1, . . . , q : < 0} and suppose that \ J\ > 1. 

Then we have, by Eq. (2.9) for A J. 0, 

b(— i(jS) 



p-q-l 



6 A (e 



II c+'iar'ni*^ 

7=1 J=l SJ 



P-g-1 



II (l + ^))^A^n 



j=i 

= fl (1 + ^feOr 1 A^(l + D( U ))(1 + o(l)), 

j=i 

where -D(u;) := —1 + Oje/^i — ^ UJ )/{~^ Ji j ~ ^ UJ )- By virtue of Lemmata 
obtain that the LHS of Eq. (3.9) converges, as A J. 0, to 



A.2 



and 



A.3 



(3.10) 



we then 



1 f 1 — cos(wt) 



7Tf 



1 + »(D(w))) dw = 1 + 



1 /" 1 — cos(w) 



7T 



K(D(u/t))du. 



Since | HjejCMj ~~ ^ jJ )/i.~f J, j ~ ^01 = 1> we further deduce that 3i(_D(u;)) < for any w 6 
Obviously, 5R(D(cj)) ^ and hence, 



1 /" 1 — cos(u;i) 



7T^ 



1 + K(D(w))) dw < 1, 



which, in turn, shows that the convergence result (3.4) cannot hold. 



□ 



Remark 3.3. (i) It is an easy consequence of the triangle and Holder's inequality that, if the 



recovery result (3.4) holds, then also 



i=i i=L*/Aj+i 



zs ua/zd. 
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(ii) Minor modifications of the proof above show that the recovery result in Eq. (3.4) remains still 



valid if we drop the assumption of causality (i.e. Assumptionu^(i)) and suppose instead only 
3?(Aj) 7^ for every j = 1, . . . ,p. Hence, invertibility of the CARMA process is necessary 
for the noise recovery result to hold, whereas causality is not. In the non-causal case, the 



obtained white noise process will not be the same as in the Wold representation (3.1). 



(Hi) The necessity and sufficiency of the invertibility assumption descends directly from the fact 
that we always choose the minimum-phase spectral factor, as pointed out in Remark\2.1\ 



(iv) The proof suggests that this procedure should work in a much more general framework. Let 
I^(-) denote the inversion filter in Eq. (3.5) and ip A 



{^^} ieN the coefficients in the 
Wold representation (|3.1|). Then the proof of Theorem 3. 2\ essentially needs, apart from the 



rather technical Lemma A. 3 that, as A J, 0, 



J fl (e- A )7{ ff (.)}H 



J™g(s) e^ s ds 



1, OJ G 



(3.11) 



provided that the function ^fcLo Vv 2 ^ does not have any zero inside the unit circle. In 



other words, we need that the discrete Fourier transform in the denominator of Eq. (3.11) 



converges to the Fourier transform in the numerator; this can be easily related to the ker- 



nel estimation result in Eq. (3.2). Given the peculiar structure of CARMA processes, this 



relationship can be calculated explicitly, but the results should hold true for continuous-time 
moving average processes with more general kernels, too. 



We illustrate Theorem 3.2 and the necessity of the invertibility assumption by an example 
where the convergence result is established using a time domain approach. That gives an explicit 
result also when the invertibility assumption is violated. 

Unfortunately this strategy is not viable for a general CARMA process, due to the complexity 
of calculations involved when p > 2. 

Example 3.4 (CARMA(2,g) process). The causal CARMA(2,g) process is the strictly station- 
ary solution to the formal stochastic differential equation 



{D-\ 2 ){D-\ l )Y t = oDL u 

{D - \ 2 ){D - \ x )Y t = a(b + D)DL U 



q = 0, 

? = i, 



and it can be represented as a continuous-time moving average process, as in Eq. (2.4), for 
Ai, A2 < 0, Ai 7^ A2 and b G M\{0} ; with kernel 



g(t) =0- 



D t\x 



t\-2 



Ai — Ao 



9(f) =°-\ ^e tx '+a 



b + A 2 JM 



Ao — Ai 



q = 0, 

q = h 



for t > and elsewhere. The corresponding sampled process = Y n &, n G Z, satisfies the 



causal and invertible ARMA(2, 1) equations, as in (2.8) where, from Eq. (27) of Brockwell et al. 

(n-l)A 



( 2012b\ > and for n G 1, 
nA 



*a(B)Y* 



g(nA - u)dL u + I [g(nA - u) - (e AlA + e X2A )g{(n - 1)A - u)]dL u . 

(n-l)A J(n~2)A 

(3.12) 
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The corresponding MA(1) polynomial in Eq. (2.8) is ®a(B) = 1 — 9 A B, with asymptotic param- 
eters 



A = ^3 - 2 + o(l), a\ = a 2 A 3 (2 + y/5)/6 + o(A 3 ) 
A = 1 -sgn(6)6A + o(A), oi = a 2 A + o(A), 



9 = 0, 
4 = 1. 



The inversion of Eq. ( |2,8| ) anc? i?g. (3.12) gives, for every A > 0, 



(■nA 

/ g(nA - u)dL u 
J(n-1)A 



(n-i-l)A 



i=Q J(n~i-2)A 



[g((n - i)A - u) - (e AlA + e A2A - A )s((™ - i - 1)A - u)]dL tt . 



Then Z A := {Z^} 

n g2 is a weak white-noise process. Moreover, using that AL n — I(n—l)A dLs> 

we have 



E[Z A AL n _j] = < 



0, 



J <0, 
J = 0, 



I °A 1 Jo A b( A + *) " (e AlA + e AzA - e A )g(s)]ds, j > 0. 



(3.13) 



For a fixed t 6 (0, oo), using the fact that AL and L A are 6oi/i second-order stationary white 
noises with variance A, we have that 



E 



[t/AJ 

E ( ZA - AL * 



Lt/AJ 

2 [t/AJ A - 2 E E[L A AL.;] - 2E E [ L f AL j 
%=i i^j 

2[t/A\A-^^[t/A\ [ g(s)ds 

0~A Jo 



2VA 



°~A Jo 



/ [g(A + s) - (e Al A + e A2A - 9 A )g(s)]ds E E A * 
J ° i=i i= i 



where the last equality is obtained using Eq. (3.13). Moreover, for every a ^ 1, 

n i—1 



i=l j=l 



_! _ a" + (1 - a)n - 1 



(l-a)2 ' 

T/ien i/ie variance of the error can be explicitly calculated as 



E 



Lt/Aj 

E (A A - A ^ 

i=i 



2\/A f A 
2 [t/AJ A —[t/AJ / 5 (s)ds 



0"A 



2x/A0a L ' /AJ + Lt/AJ (1- A ) -1 /" A 



<7A 



(1-#a) 2 



/ [ 5 (A + S )-(e AlA + e A2A -0 A ) 9 ( S )]d S . 

JO 
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We now compute the asymptotic expansion for A J, of the equation above. We obviously have 
that 2 [i/AJ A = 2t(l + o(l)) and, using the explicit formulas for the kernel functions g , 



^L*/AJ/ A g(s)ds = 
^ J A [ 5 (A + ») - (e^ A +> A - e A )g(s)]ds = 



y 9 A L'/ A J + Lt/AJ (1 - © A ) - 1)(1 - 9a)" 2 
Hence, for a fixed t £ (0, oo) and A J. 0, we get 

E 



(3 - V3) t + o(l), 
(4V3-6) A(l + o(l)), 
|(3 + a/3) t/A(l + o(l)), 



2t + o(l), 

2(&-sgn(fe) &)A 2 + o(A 2 ), 

(e - sg n(b)6i + sgn ( 6 ) W _ i)/(6A) 2 + o(A- 2 ). 



Lt/AJ 



o(l), g = 0, 

2( e - s g n ( 6 ) w + sgn(b)6t-l)(sgn(6)-l)/6 + o(l), g = 1, 



i.e. (3.4) ZioWs always for q = 0, whereas for q = 1 if and only if b > 0. If b < 0, i/ie error 
approximating the driving Levy by inversion of the discretized process grows as At for large t. 



4 High-frequency behaviour of approximating Riemann sums 



The fact that, in the sense of Eq. (3.3), ~ AL n = L nz \ — £( n _i)A f° r small A, along with 



Eq. (3.2), gives rise to the conjecture that the Wold representation Eq. (3.1) for behaves on 



a high-frequency time grid approximately like the MA(oo) process 



Y, 



A,h 



oo 

E 

3=0 



g(A(j + h))AL r 



-j- 



(4.1) 



for some h S [0, 1] and g is the kernel function as in (2.6). In other terms, we have for a CARMA 



process, under the assumption of invertibility and causality, that the discrete-time quantities 



appearing in the Wold representation approximate the quantities in Eq. (4.1) when A \, 0. The 



transfer function of Eq. (4.1 ) is then defined as 



X>(A(i + /0K 



-IT < 0J < 7T, 



(4.2) 



3=0 



and its spectral density can be written as 



2tt 



l^ A | 2 < 



UJ 



-7T < OJ < 7T. 



It is well known that a CMA process can be defined (for a fixed time point t) as the L 2 -limit of 



Eq. (4.1 ); this fact is naturally employed to easily simulate a CMA process, when all the relevant 
quantities are known a priori. Therefore we will name the process Y^ ,h approximating Riemann 
sum of Eq. (2.4), and h is the so-called rule of the approximating sum; e.g. if h = 1/2, we have 



the popular mid-point rule. 

In order to give an answer to our conjecture, we will investigate properties of the approx- 
imating Riemann sum Y^ h of a CARMA process and compare its asymptotic autocovariance 
structure with the one of the sampled CARMA process Y A . This will yield more insight into the 
role of h for the behavior of Y A ' h as a process. 

We start with a well known property of approximating sums. 
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Proposition 4.1. Let g be in L 2 and Riemann-integrable. Then, for every h £ [0,1], as A 4- 0: 
(i) Y^' h - Y k A ^ 0, for every k G Z. 

(nj ^u/aj ~^ ^t, f or every t € K. 

Proof. This follows immediately from the hypotheses made on g and the definition of L 2 -integrals. 

□ 

This result essentially says only that approximating sums converge to Yj for every fixed t. How- 
ever, for a CARMA(p, q) process we have that the approximating Riemann sum process satisfies 
for every h and A an ARMA(p, p — 1) equation (see Proposition 4.2 below), meaning that there 
might exist a process, whose autocorrelation structure is the same as the one of the approxi- 
mating sum. Given that the AR filter in this representation is the same as in Eq. (2.8), it is 
reasonable to investigate whether & A (B)Y A and <fr A (B)Y A ' h have, as A J. 0, the same asymp- 



totic autocovariance structure, which can be expected but is not granted by Proposition 4.1 



The following proposition gives the ARMA(j>, p — 1) representation for the approximating 
Riemann sum. 

Proposition 4.2. Let Y be a CARMA(p, q) process, satisfying Assumption^ and furthermore 
suppose that the roots of the autoregressive polynomial a(-) are distinct. Then the approximat- 
ing Riemann sum process Y^' h of Y defined by Eq. (4.1) satisfies, for every h E [0,1], the 
ARMA(p,p — 1) equation 



where 



and 



$ A (B)Y*> h = aQ A>h (B)AL n , n€Z, (4.3) 
&A,h(z) := 9*> h - 6?> h z + -... + (-l)f- 1 ^^- 1 (4.4) 

:= y y e A(A J1+ A 32+ ... + A Jfc)) k = 0,...,p — l, 

where the right-hand sum is defined to be 1 for k = and it is evaluated over all possible subsets 
{jii • • • tjk} °f {1> • • • )P}\0}> having cardinality k, for k > 0. 

Proof. Write $ A (» = l¥j=i( l ~ e AAj z) = - YJj=o <\>f zi and observe that 

^{B)Yt h = -Y.<t>t Y nl 
3=0 

= " CTbT E ( E 0f^ MA ) e AhA e p • AL n _ fc 

k=0 \j=0 J 

p oo 

j=0 k=p-j 




AhA a j 
e e„ • lAL n - k 
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-ab T - E # e ~*' A e A ^ +fc ) A e p • AL 



n—k- 



k=p 



3=0 



By virtue of the Cayley-Hamilton theorem (cf. also (Brockwell and Lindner , 2009 proof of Lemma 
2.1)), we have that 



3=0 



-AjA 



0, 



and hence, $ A (B)Y^ h = -ab T (^=q <pfe A ^ A 

(Fasen and Fuchs||2012| Lemma 2.1 (i) and Eq. (4.4)). 



^AhA 



e„ • AL n _^. We conclude with 

□ 



Remark 4.3. (i) The approximating Riemann sum of a causal CARMA process is automati- 
cally a causal ARMA process. On the other hand, even if the CARMA process is invertible 

the roots of 0A,h(") rnay lie inside the unit circle, causing 



in the sense of Definition 
Y A ' h to be non-invertible. 

KA,h 



3.1 



(ii) It is easy to see that 9 ' = g{hA). Then for p — q > 2, if h = 0, we have that 9, 



nA,0 



0. 



giving that ©a,o(0) = 0- This is never the case for @a(')> as one can see from Eq. (2.9) 



and Proposition \2.2\ Moreover, it is possible to show that for h = 1 and p — q > 2, the 
coefficient is 0, implying that Eq. (4.3) is actually an ARMA(p,p — 2) equation. For 
those values of h, the ARMA equations solved by the approximating Riemann sums will 
never have the same asymptotic form as Eq. (2.8): therefore we shall restrict ourselves to 
the case h £ (0, 1) from now on. 

( iii ) The assumption of distinct autoregressive roots might seem restrictive, but the omitted cases 
can be obtained by letting distinct roots tend to each other. This would, of course, change 



the coefficients of the MA polynomial in Eq. (4.4). Moreover, as shown in Brockwell et al. 



(2012a, b), the multiplicity of the zeroes does not matter when I? -asymptotic relationships 
as A ^ are considered. 

Due to the complexity of retrieving the roots of a polynomial of arbitrary order from its 
coefficients, finding the asymptotic expression of @A,h(') f° r arbitrary p is a daunting task. 
Nonetheless, using Proposition 4.2 it is not difficult to give an answer for processes with p < 3, 
which are the most used in practice. 

Proposition 4.4. Let Y A,h be the approximating Riemann sum for a CARMA(p, q) process, 
with p < 3, let Assumption^ hold and the roots of a(-) be distinct. 

If p = 1, the process Y A,h is an AR(1) process driven by Z A 
If p = 2, 3, we have 



AL n , for every A > 0. 



®a{B)Y£ 



A,h 



i=l 



p-q-1 

(l-A/Zi + o(A))B) Yl (1 - Xp - q ,i(h)B) 



8=1 



cr- —AL n 



(P 



(4.5) 



where, for h £ (0, 1) and A J, 0, X2,i(h) = (h — l)/h + o(l) and 

2(h-l) 2 



X3,j{h) 



2{h -l)h-l- {-l)3\Jl-A{h-l)h 



+ o(l), j = 1,2. 
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Proof. Since p < 3, ®Ah( z ) is a polynomial of order p — 1 with real coefficients; therefore the 
roots, if any, can be calculated from the coefficients, and asymptotic expressions can be obtained 
by computing the Taylor expansions of the roots around A = 0. 

If p = 1, the statement follows directly from Eq. (4.3). For p = 2,3, the roots of Eq. (4.4) are 
{1 + Afii + o(A)} i= i > ... j9 and {l/x p - g ,i(/j)}i=l,...p-g-l J giving that 

®A, h (z) = n^ 1 + a ^ + °( a ) - z ) n (vxp-,,< w - «), * e c. 



i=l 



Vieta's theorem gives that the product of the roots of Eq. (4.4) is equal to Oq^/O^I, which 
yields 



p-q-l 



e A , h (z) = e£' h H(l-(l-A f , l + o(A))z) J] (l- Xp - q ,i(h)z). 



Since 9^ h = g{hA) = a(hA) p - q - 1 / {p ~Q~ + oC 1 ))) we nave established the result. □ 

In general the autocorrelation structure will depend on h through the parameters Xp-q,i(h), 
i = 1, . . . ,p — q — 1. In a time-series context, it is reasonable to require that the approximating 
Riemann sum process has the same asymptotic autocorrelation structure as the CARMA process 
we want to approximate. 



i=l 
\p-q-l 



i=l 



Corollary 4.5. Let the assumptions of Proposition 4-4 hold. Then &a(B)Y a and ^^(B)Y A ' h 
have the same asymptotic autocovariance structure as A \, 



for every h £ (0, 1), 

for h = (3±\/3)/6, 



and for h 



15 ± V 225 - 30V30 



J/30, 



ifp-q = i) 
ifp-q = 2, 

tfp-q = 3. 



Moreover, the MA polynomials in Eqs. (2.9) and (4.5) coincide if and only if the CARMA process 
is invertible and \x p -q,i(h)\ < 1, that is 



for every h € (0, 1), 

for h = (3 + V3) /6, 

For p — q = 3, such h does not exist. 



ifp-q = 1, 
ifp-q = 2. 



Proof. The claim for p — q = 1 follows immediately from Proposition 4.4 and Eqs. (2.9)-(2.10). 
For p = 2 and q = 0, we have to solve the spectral factorization problem 

al(l + v(^) 2 ) = cT 2 A 3 (l + X2,i(h) 2 )h 2 
al V (^) = -a 2 A 3 X2 ^h)h 2 



with 7/(£i) = 2 — v3 + o(l) andx2,i(^) = (/i— l)//t + o(l). Eq. (2.10) then yields the two solutions 
h = (3 ± \/3)/6. For j) = 3 and g = 1, analogous calculations lead to the same solutions. Finally, 
consider the case p = 3 and q = 0. We have to solve asymptotically the following system of 
equations 



^A(l + M6) + rK&)) 2 + ^i)Vk) 2 ) 



a 2 A 5 



;i + (X3,i W + X3,2(fc)) 2 + X3,i(h)' z X3,2(h) 2 )h 4 
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*A + »7(&))(1 + = -^-(X3,i W + X3,2(/i))(l + X3,i(^X3,2(^))/i 4 

CJ 2 A 5 

OA^lhte) = ^^X3,l(/i)X3,2(/i)/l 4 

where 7/(^1,2) = (13 ± \/l05 - \/270 ± 26\/l05) /2 + o(l) and X3,lO) and X3fi( h ) are as in 
Proposition |4,4| Solving that system for h gives the claimed values. 

To prove the second part of the Corollary, we start observing that, under the assumption of 
an invertible CARMA process, the coefficients depending on m will coincide automatically, if 
any. Then it remains to check whether the coefficients depending on h can be smaller than 1 in 
absolute value. The cases p — q = 1, 2 follow immediately. Moreover, to see that there is no such 
h for p — q = 3, it is enough to notice that, for h E (0, 1), \x3 l{h)\ > 1 and < \%3 2(h)\ < 1, i.e. 
they do never satisfy the sought requirement for h E (0,1). □ 



Corollary 4.5 can be interpreted as a criterion to choose an h such that the Riemann sum 
approximates the continuous-time process Y in a stronger sense than the simple convergence 
as a random variable for every fixed t. The second part of the corollary says that there is an 



even more restrictive way to choose h such that Eqs. (2.9) and (4.5) will coincide. If the two 
processes satisfy asymptotically the same causal and invertible ARMA equation, they will have 
the same coefficients in their Wold representations as A J, 0, which are given in the case of the 



approximating Riemann sum explicitly by definition in Eq. (4.1). 



In the light of Eq. (3.2) and Theorem 3.2, the sampled CARMA process will asymptotically 



behave like its approximating Riemann sum process for some specific h = h, which might not 



even exist, as in the case p = 3, q = 0. However, if such an h exists, the kernel estimators (3.2) 
can be improved to 

^g/Aj =g(A([t/A}+h)) + o(A), t€R. 



For invertible CARMA(p, q) processes with p — q = l, any choice of h would accomplish that. 
In principle an h can be found matching a higher order expansion in A, where higher order terms 
will depend on h. 

For p — q = 2, there is only a specific value h = h := (3 + \/3)/6, such that Y^' h behaves 
as y A in this particular sense, and therefore it advocates for a unique, optimal value for, e.g., 
simulation purposes. 

Finally, for p — q = 3, a similar value does not exist, meaning that it is not possible to mimic 
y A in this sense with any approximating Riemann sum. 

In order to confirm this, we now give a small numerical study. We consider three different 
causal and invertible processes, a CARMA(2, 1), a CAR(2) and a CAR(3) process, with param- 
eters Ai = -0.7, A 2 = -1.2, A 3 = -2.6 and m = 3. Of course, for the CARMA(2, 1) we use 
only Ai,A2 and fii, while for the CAR processes there is no need for Then we estimate the 



kernel functions from the theoretical autocorrelation functions using (3.2) as in Brockwell et al. 
(2012a), for moderately high sampling rates, namely 2 2 = 4 (Figure |l| and 2 6 = 64 samplings 



per unit of time (Figure [2]). In order to see where the kernel is being estimated, we plot the kernel 
estimations on different grids. The small circles denote the extremal cases h = and h = 1, the 
vertical sign the mid-point rule h = 0.5, and the diamond and the square are the values given in 
Corollary |4,5[ if any. The true kernel function is then plotted with a solid, continuous line. For 
the sake of clarity, only the first 8 estimates are plotted. 
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For the CARMA(2, 1) process, the kernel estimation seems to follow a mid-point rule (i.e. 
h = 1/2). For the CAR(2) process, the predicted value h = (3 + v3)/6 (denoted with squares) 
is definitely the correct one, and for the CAR(3) for every h £ [0, 1] the estimation is close but 



constantly biased. Of course in the limit A | 0, the slightly weaker results given by Eq. (3.2) 



still hold, giving that the bias vanishes in the limit. The conclusion expressed above is true for 
both considered sampling rates, which is remarkable since they are only moderately high, in 
comparison with the chosen parameters. 



CARMA(2,1) process CAR(2) process 



CAR(3) process 




Figure 1: Kernel estimation for a sampling frequency of 2 2 samplings per unit of time, i.e. 
A = 0.25. The diamond and the square symbols denote, where available, the values of h suggested 
by Corollary |4.5| 



5 Conclusion 

In this paper we have dealt with the asymptotic behaviour of two classes of discrete-time processes 
closely related to the one of CARMA processes, when the sampling frequency tends to infinity. 

First, we studied the behaviour of the white noise appearing in the ARM A equation solved by 
the sampled sequence of a CARMA process of arbitrary order. Then we showed, under a necessary 
and sufficient identifiability condition, that the aforementioned white noise approximates the 
increments of the driving Levy process of the continuous-time model. The proposed procedure is 
non-parametric in nature, and it can be applied without assuming any knowledge on the order 
of the process. Moreover, it is argued that such results should be extendable to CMA processes 
with more general kernel functions. This is left for future research. 



The results in the first part of this paper, considered jointly with those in Brockwell et al 



(2012a), show that the Wold representation of a sampled causal and invertible CARMA process 
behaves somehow like a Riemann sum as A ^ 0. Then in the second part of this paper the converse 
is investigated, i.e. whether a Riemann sum approximating a causal CARMA process satisfies 
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CARMA(2,1) process CAR(2) process 



CAR(3) process 




0.02 0.04 0.06 0.08 0.1 0.12 
t 




0.02 0.04 0.06 0.08 0.1 0.12 
t 




0.02 0.04 0.06 0.08 0.1 0.12 
t 



Figure 2: Kernel estimation for a sampling frequency of 2 6 samplings per unit of time, i.e. A ~ 
0.016. The diamond and the square symbols denote, where available, the values of h suggested 



by Corollary 4.5 



the same ARMA(p,p — 1) equation of the process we want to approximate, as the spacing of 
the grid tends to zero. This is in particular important for simulations, where such approximating 
Riemann sums constitute a natural choice. 

It has been shown that these processes satisfy an ARMA(p, p — 1) equation, but in general 
they are not invertible. For p < 3, the roots of the moving average polynomial of such discrete- 
time processes depend, apart from the roots of &(•), also on the rule h. Moreover, in the case 
p = 3, q = 0, the Riemann sum is invertible for no choice of h, implying that the Riemann sum 
and the sampled process will never satisfy asymptotically the same causal and invertible ARMA 
equation. Although only a finite number of cases has been considered, it shows that in general a 
causal and invertible CARMA process cannot be approximated by a Riemann sum, at least not 



in the sense of the second part of Corollary 4.5 Further investigations on this matter are left for 
future research. 



A Auxiliary Results 

Throughout the appendix, we shall use the same notation as in the preceding sections. 



Proposition A.l. The function a n (x), as defined in Eq. (2.12), has the form 

Pn(x) 



a n (x) 



1 



(2n + 1)! x n+l ' 
where P n {x) is a polynomial of order n in x, namely 

k 

T 

2k 



x 7^ 0, n 6 N, 



(A.l) 



3=0 k=j+l L J i=j 



i + lU 2k 
j + 1 J \2i + 1 



3 + 1 



2k 
2i 



(-2) 



j+l-2k 
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j=0 k=j 



i + /2fc+l 
i + lJ \2i + 1 



i + i 



2fc + l 
2« 



(_2)i- 2fc , 
(A.2) 



TOi/i {^} feeing i/ie Stirling number of the second kind. Moreover, all the zeroes of a n (x) are real, 
distinct and greater than 2. 



Proof. Using the definition of the hyperbolic functions, we can write 



sinh(z) 



„2z 



cosh(z) - 1 + x e 2z + 1 + 2(x - l)e 2 



--: f(z,x), z G 



x^O, 



i.e. f(z, x) = g(e z , x), where g(y, x) :={y 2 — l)/(y 2 + 1 + 2{x — l)y). Then the re-th derivative of 
the function f(-,x) is, by the Faa di Bruno formula 



gn 

Ik? 



■f(z,x) 



gn 

dz 



-g(e z ,x) = ^2 



k=l 



n 



k 



k\ dy> 9M 



z G 



x^O, 



y=e 



where the coefficients {^} are the Stirling numbers of the second kind. Using the previous formula 
and the definition of a n (x), for x ^ 0, 



^271+1 

(2n + l)!a n (x)= ^+r/(*,aO 



2n+l 

fe=i 

2n+l 

fc=i 



z=0 



2n+l 

E 

fc=i 



2n+ 1 
k 



gk 

dy 



k g(y,x) 



f2n+l] 




I k J 




f2n + ll 




I * J 


*2^/ 



(z-l)(z + l) 



J 2m J p {z - a 2 {x))(z - ai (x))(z - l) fc +! 
+ 1 



dz 



J 27rz 7„ (z — a%(x))(z — a\(x))(z - l) k 



dz 



(A.3) 



where the latter equality comes from the Cauchy differentiation formula, a\{x) = 1 — x — 
y/x(x — 2), a2(x) = 1 — x + y/x(x — 2), i.e. they are the roots of the polynomial y 2 + l + 2(x— l)y, 
and p is a counter-clockwise oriented closed curve in the complex plane encircling z = 1. The 
case x = has been excluded because /(•, 0) is not defined in z = 0, and lim 2 _>o \ f(z, 0)| = oo. 

Let us denote the integrand in Eq. ( |A,3 ) by /fc(z, x); it is a rational function having one pole 
of order k in z = 1. Moreover, there are two simple poles in z = ai(x) and z = ci2(x) if x ^ 2, 
or just a simple one in z = — 1 if x = 2, due to cancellation with the zero at z = — 1 in the 
numerator. The case x = 2 can be also obtained by letting the difference between a±(x) and 
d2(x) tend to zero in the upcoming calculations and is therefore not treated by itself. 

Then by the Cauchy theorem of residues, Theorem 1, p. 24 of Mitrinovic and Keckic ( 1984 ) , 
we have that the integral in Eq. (A.3 1 is 



1 

2vri 



f k (z,x)dz = Resf k (z,x) 

z=l 



Res f k {z,x) 

z=a\ (x) 



Res f k (z,x) - Res f k (z,x), x^0,2, 

z=a,2(x) z=oo 



where the latter identity is obtained using Theorem 2, p. 25 of Mitrinovic and Keckic (1984). 
Moreover, since the difference of orders between the polynomials in the denominator and in the 
numerator of f k (z,x) is k + 1 > 1, the residue at infinity is always zero (Section 3.1.2.3, pp. 
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27-28, Mitrinovic and Keckic (1984)). For x ^ 0, 2, we have that z = a\(x) and z = a 2 (x) are 

1 + a 2 (x) 



simple poles, yielding 
fk(z,x)dz = 



1 

2ri 



1 + ai(x) 

(ai(x) - l) k (a 2 (x) - ai(xj) (a 2 (x) - l) k (a 2 (x) - ai(x)) 

[k/2] 



i=0 
L*/2J-1 [k/2] 

■ E E 

3=0 i=3 



k 

2i + l 
i + 1 



(-*r + 



A; 



A; 

2i + l 

i 

i + i 



(-x) fc ~ 2i (a;(a; - 2)) i 



+ (ife mod 2 )(-2)L fc / 2 J+ 1 - fe x-L fc / 2 J- 1 ; 



where the last equality is obtained by using the Binomial theorem. Plugging Eq. (A. 4) in 
Eq. (A.3), and dividing the outermost sum in odd and even k, we get, still for x ^ 0, 2, 



(2n + l)!on(x) 

n k—1 k 

k=l j=0 i=j 
n k—1 k 

fc=0 j=0 i=j 



2n+l 
2k 



2n + 1 
2k + 1 



i + lW 2k 
j + l) \2t + 1 

i + 1\ (2k + 1 
j + 2i + l 



i + i 



2A- 
2i 



. 2 y+i-2fc x -i-i 



i \ pfc + 1 

i + VV 2» 



-2) 



j-2k x -j-l 



+E(^ + D!{':: 1 i }(-^-'- 1 . 

fc=0 k ^ 



Then Eq. (A.l) can be obtained by merging the last two lines and rearranging the indices. 
Using Eq. ( A. 2 ), we easily see that, for P n (x) = po + p\x + . . . + p n x n , 

po = (-2)~ n (2n + l)!, Pn = l, (A.5) 

i.e. P n (x) will have n, potentially complex, roots, and they can not be zero. Moreover it is easy 
to verify that f(z, x) solves the mixed partial differential equation 



dz 



d 

(x-l)— +x(x-2) 
ox 



dx 



f(z, x), z G C, x ^ 0. 



(A.6) 



Then we take 2n — 1, n G N, derivatives in z on both sides of Eq. (A.6); invoking the Schwarz 
theorem, the product rule for the derivatives and evaluating the resulting expression at z = 0, 
we obtain that the function a n (x) is given by recursion, for x (0, 2), 



(2n + 3) (2n + 1) a n+1 (x) = ^Jx{x - 2) 
ao(x) = 1/x. 



d_ 

dx 



Q 

yjx{x - 2)—a n (x) 



(A.7) 



We now prove by induction the claim regarding the roots being real, distinct and greater than 2. 
The cases ao(x) = 1/x and 6ai(x) = (x — 3)/x 2 have respectively no and one zero, so the claim 
can only be partially verified; then we start from a 2 (x) = (30 — 15x + x 2 )/(120x 3 ), whose zeros 
are £ 2 ,i = 1/2 (15 - y/W5) w 2.37652, 6,2 = 1/2 (15 + \Zl05) w 12.6235, and they satisfy the 
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claim. We now assume that the claim holds for a n (x), n > 2, and its zeros are 2 < £ nj i < £ nj 2 < 

• • • < £n,n- 

The derivative of a n (x) is of the form Q n (x)/x n+2 , where (2n + l)\Q n (x) = xJ^P n (x) — 
(1 + n)P n (x). By Rolle's theorem, Q n {x) has n — 1 real roots Xn,i> * = 1, 1, such that 

2 < £n,l < Xn,l < £,n,2 < Xn,2 < ■ ■ ■ < Xn,n-i < £n,n- Using the product rule and the value of the 
coefficients in Eq. (A. 5), we get 

-a n (x) x~ 2 /(2n + 1)! -»■ 0, x -»■ oo. (A. 8) 



<9x 

Again by Rolle's theorem, since ^& n (x) — > and a n (x) — > as x — > oo, Q n {x) has a zero at 
some point £„ )n < x n>n < oo. For x > 2, the function y/x(x — 2)J^a n (x) is well defined and it 
is zero for x = 2 and x = Xni^ = 1, • • • , re. With the same arguments as before, we then obtain 
that ^[y / x(x - 2)^ x a n (x)] is zero for x = £ n +l,i, i = 1, • • -,n + 1, where 2 < £ n +l,i < Xn,l < 
Cn+l,2 < Xn,2 < • • • < Xn,n < £n+l,n+l < oo. Then by Eq. ( A.7 |, those zeros are also roots of, 
respectively, a n +i(x) and P n+ i(x). Since P n +i(x) is a polynomial of order n + 1, it can have only 
n + 1 roots, which were already found. Moreover, they are all real, distinct and strictly greater 
than 2, and the claim is proven. □ 

Lemma A. 2. Suppose that ^t(fJ^j) 7^ for all j = 1, . . . , q. Then we have, for any t 6 (0, oo) 
and oj G M\{0} 7 



limj v/A l-co S (a;|t/A]A) sin(^A) ^ / n|=i(l ~ e A ^+^) fe(-jg) 
A^o cja w l-cos(wA) 1 6A(e iwA ) o(— iw) 

_ 2 - 2cos(wt) 



CJ 2 



anc? 



A4.0 a A w I G A (e^ A ) a(-iuj) j 



where D(uj) := —1 + Y\j &J (fj,j — iuj)/(—/j,j — ico) and J := {j = 1, . . . , q : < 0}. Obviously, 

if > /or all j = I, . . . , q, then D(u) = /or a// 



Proof By Proposition 2.2 we have that ^(^) 6 (0, 1) for sufficiently small A. Hence, for any 
n^ 1 (l-e A ^ + ^)b(-iq;) 1 p e A(A J+ H_i ^ ^._ iuJ 

= A^(l + DM) fl (1 + r?^))- 1 • (1 + o(l)) as A | 0. 

3=1 



Moreover, using Eq. (2.10), we obtain 



a \/[2(p-?)-i]!'nn" 1 '?fe) 



(7— = ^ (l + o(l)) asA|0. 
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Since cos(u}[t/ A\A) _^ C os(ut) and A sin(wA)/(l-cos(wA)) -> 2/w as A | for any a; <E M\{0}, 
we can use the equality (cf. ( Brockwell et al.j 2012a proof of Theorem 3.2)) 

'[2(p-?)-i]!-i^r 1 ^-) 



T-rp-g-i M , v (c.)\ 

ii3 ~ 1 ' ^i.(i + (i)) = i + (i) asA|0 



to conclude the proof. 



□ 



Lemma A. 3. Suppose that t £ (0, oo) and 3?(//j) 7^ for all j = 1, . . . , q, and let the functions 



ft, A,1 (-), /i A,2 (-) anc? /i.w^j (•) 6e defined as in the proof of Theorem 
such that, for any 00 £ R anc? any sufficiently small A, 



5.5 Then there is a C > 



2K (/A 1 • hf t f Aj (u) ■ /A 2 ■ hf t f Aj (a,)) < 

where h(oj) := (7 2 P/2 2p+q + lj£ 2 l(_i ^(a;) + Cco~ 2 l^\ /^(u;). Moreover, h is integrable over 
the real line. 

Proof We obviously have 

2K (/A 1 • hf t f Al ( W ) • ^^H) I < l^' 1 • ^) 3 AJ («) " 



+ 



,A,2 . , A,3 



(A.9) 



for any oj £ R and any A. Let us first consider the second addend on the RHS of Eq. (A.9). 

We obtain |/i A < 2 • hy? A , (oj)\ 2 = 2(1 -cos(w^/AJ A))/u 2 and since |_^/AJ A < t holds, we can 
bound, for any A, the latter function by t 2 on the interval (—1, 1) and by 4/w 2 on R\(— 1, 1). 

As to the first addend on the RHS of Eq. (A.9), we calculate 

2 



A,l iA,3 



h*< L ■ h 



[t/AJ 



a' 



a 



A n^=i|l-e A(Aj+M | \H-iLo)\ 2 1-cos^Lt/AJA) 
|9 A (e^ A )| 2 \a{-iu)\ 2 ' l-cos(wA) 



(A.10) 



Let now \oo\ < 1 and suppose that A is sufficiently small, i.e. the following inequalities will 
be true for any \oj\ < 1 whenever A is sufficiently small. Using |1 — e z \ < 7/A\z\ for \z\ < 1 (see, 
e.g., (Abramowitz and Stegun 1974 4.2.38)) yields 



m =1 |i-e 



|o(— ioS) 



< 



-A' 



Then, (1 - cos(u;A))/(u;A) 2 > 1/4 together with 4(1 - cos(w[i/AJ A))/o; 2 < 2t 2 (see above) 
implies 



1 - cos(c4*/AJA) 
1 — cos(u;A) 



< 2 



t 

A 

p-q-l 



As in the proof of Lemma A. 2 we write © a(z) = YVj=l + vi^j) 2 ) ' EI|=i(l ~~ (j z )i where 
Cj = 1 - sgn(SR(/Uj)) fij A + o(A) (see |Brockwell et al.| ( |2012a[ ), Theorem 2.1). Since 
Uj=i (I 1 - Cj^ A \ /A) 2 > n|=i 1/2 |sgn(K(/ij)) Mj - ^| 2 > we further deduce 



|6(-iw)r 



ni=iii-o^ A i 2 



< 



2 q 

A 2 ^' 
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Again due to Eq. (2.10), we obtain 



a 2 A TTll +n(f V^P 2 < 2-[2(p-g)-l]! ^ 



p-g-i 



+ »?(^)e < 



and since < 1 for all j (see Proposition 2.2) we also have that \^+r}{^j)e llJJ ^\ > ^|l + r? (£•/)! 

for all j, resulting in 



p-q-1 



i=i 



2 2(p- g )-l 



where the latter equality follows from (Brockwell et al. 2012a proof of Theorem 3.2). All to- 
gether the RHS of Eq. (A. 10) can be bounded for any \u\ < 1 and any sufficiently small A by 
(7/2) 2p 2~H 2 . 

It remains to bound the RHS of Eq. (A. 10) also for \cj\ > 1. Hence, for the rest of the proof 
let us suppose |w| > 1 and in addition we assume again that A is sufficiently small in order that 
all the following inequalities hold. We are going to show that 



2 A ]lj=i I 1 - e A(A ^ } | \b(-iu)\ 2 1 - cos(u[t/Aj A) < C_ 
~ ' \a(-ico)\ 2 1 - cos(wA) ~ - 2 



a 



|e A (e 



for some C > 0. Since \a 2 A/a 2 A \ < const. • \A 2 /A 2 ^~^\ (see glo] )) and since n?=i I 1 + 



iaAi-2 



< YYj=t 1 ( 1 - \v(€j)\)~' 2 < const - ( cf - Proposition 



2.2 



it is sufficient to prove 



(uoA) 2 IlLi I 1 - e A ^+^)| 2 \b{-iuo)\ 2 1 - cos(w |_*/AJ A) 



A 2( P -g) n?=iii-o e<wA i 



ai—iu; 



1 — cos(wA) 



< C 



(A.ll) 



for some C > 0. The power transfer function satisfies \b(—ioo)\ 2 /\a(—iui)\ 2 < const. /(uj 2 ^ p q ^ + 1) 
for any Thus, Eq. (A.ll) will follow from 

II?=i |1 - e A ^'+-)| 2 l _ cosKi/Aj A) 



(wA) 2 (p-«) + A 2 (p-9) TT?_ 1 II - C,-e itjA | 2 1 - cos(wA) 

± ±J 1 J 



< C. 



(A.12) 



We even show that Eq. (A.12) is true for any uj E R. However, using symmetry and periodicity 
arguments it is sufficient to prove Eq. (A.12) on the interval [0, We split that interval into 
the following six subintervals 

I Mi I 



h :-- 



0, min 

'i=l,..,? 2 



min — — , max 2\Hj\ 
j=l,-,g 2 j=l,...,q 



7r 2ir 

— , — max 2 u, 

A' A i=i,...,, 



4 := 
~2vr 



, 2vr 



7T 



max 2 //,• , — 

j=l,...,q J A 



27T 27T |/i 7 -| 

— max 2 ll,- , — min — — 

A j=l,..., q 3 A i=i,..., 9 2 

iMil 2tt' 



and 



— mm . , 

A j=l,...,q 2 ' A 



For any u G /i U 4, the fraction 1 i^cosfcj A) ^ can ^ e bounded by [i/AJ 2 . In the other 



intervals we have the obvious bound 



1— cos(wA) 



for that term. 
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Now, for any j = 1, . . . ,p, we have, as A J, 0, 



1 - e AX > ■ e iwA 



< 2 |1 - e ia;A | 2 + 4A" \\j\ A = 8sm z ( j + 4A^ |A,f < 4A^ [lo' z + |A, 



.2 I \ |2 



. 2 I \ |2 / j a2 / , ,2 



if w € h U I 2 U I 3 , and |l - e AA ^ • e iu]A \ 2 < 4A 2 ((2vr/A - lo) 2 + (A/) if u € I 4 U J B U J 6 . 
The first fraction on the LHS of Eq. (A. 12) satisfies 



;A) 2 (P-?) + A 2 (P~9) 



< < 



, 4gy, if W G/ 4 U/ 5 U/ 6 . 



Then, for any j = 1, . . . , q and w 6 Ii U 16, we obtain 
iuiA I 2 



\l-Qe 

>^A 2 N 2 
If w € ^3, then we have 



1 - (1 - sgn(K(^)) ^'A + o(A))e^ A | 2 > ^A 2 |sgn(K(^)) H ~ M 



|1 - 0e^ A | 2 > (|1 - e^ A | - | Mj + o(l)| A) 2 = ( 2 sin (^) 
>A 2 Q w -|/x i + (l)|) 2 



l^ + o(l)| A 



and likewise, for w G I4, we deduce |l — (je lwA \ 2 > A 2 (|( 
for arbitrary e > 



2rr 



+ o(l)|) 2 . On I 2 we get 



\1-Qe 



iuiAl 2 



2(1 - cos(wA)) • (1 - A sgn(5ft(/i j )) + o(A)) 

+ 2sin(a;A) • (-A sgn(5ft(/i j )) $*(//,•) + o(A)) + A 2 |/x/ + o(A 2 ) 
> (ojA) 2 ■ (1 - e) - 2(wA) • A |<Sfo)| • (1 + e) + A 2 (|^| 2 + o(l)) =: / E A (wA). 

Since f A (uo)/u) 2 — > 1 — e (u> — )• 00) and f A (u})/uj 2 — > 00 (w — )• 0), a (global) minimum of 
f A (uj)/uj 2 on (0,oo) could be achieved in any w* with (a^^J^)(^*) = 0. The only such value 



is w * = A $t&^ . Since 



*^2 



l-e-(H-e) 



N 2 + o(l) 



>(! + £) 



N 5 



2 | M ,f ' 



if we choose e 



1 ap^) 2 



we obtain ^ s 1"^ > i^p^- for any u> G (0, 00). Hence, 



l-0e^ A | 2 >/f^A)> 



1K (^) 2 ^,AA2 



wA) 2 for all U e I 2 . 



2 |^| 2 

Using periodic properties of the sine and cosine terms, we likewise get 



l-Cje 



i^A|2 > IKifij) 2 a2 [2n 



2 \^ ~ A I A ""I foran ^ G/ 5. 
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Putting all together, we can bound the LHS of Eq. ( A.12| ) in I\ by 
, l^-l (Li/Aj A) 2 4^A 2 p • UU ( min fc=i,.., g l^| 2 /4 + |A,f) 

TY11T1 — . 

^ ■ \H\ + 2 4 p+9 -n^ = i(min fc=1 ,..., (? |/i fc | 2 /4 + |A J | 2 ) 

< mm — — • t • -f. 1 

-i=i,.. >9 2 nj=iJiMii a 



in I2 by 



2(o;A) 2 4^A 2 ^ ■ U%i (4max fc=1 ,„„ g |^| 2 + |A,| 2 ) 
l-cos( W A) (wA) 2p. n « =i i^ 



, 5 • 4 2 ^ • U P j=1 (4max fc=1 ,„„ g |^| 2 + |A,| 2 ) _ (< 



in I 3 by 



1 - cos(wA) (wA) 2 (p-9) • (4 W A) 2 « 

<7r 2 4?20 2 «f[(l + - |Ajf , . 2 )=C, 



in I4 by 



(2vr) 2 2 ^-^•n? = i(i + 4 ^,' a ,,i, fc | 

^(p-g) 1 _ cos (a;A) 20- 2 9 (2tt - uA) 2 <? 

P / I\.l2 \ o. fn„ , ,A\2 



< ^ 2o 2 « fr f 1 + ^ 2 -( 27r -" A ) 2 

^ = -L ^ 4maxjfc =lj ... j? |/x fc | 2 / 1 - cos(27r - wA) 
<7r 2 4P +1 20 2 *frfl + - I'M* =C, 



in I 5 by 

(2^) 2 2 4PA 2 ? • n^ = i (4max fc= i,..., g |// fc | 2 + [A/) 

^2(p-,) 1 _ cos(u; A) A 2 <? ]Tj=i I : , |//*| 2 (»(Mi)/M) 2 

_ (2^) 2 4^ • J] - = i (4max fc=1 „„, g | Mfc | 2 + |A 3 -| 2 ) 2A 2 

- ^(p-i) UU l min fc=lj ... >9 |>x*| 2 (»(Mi)/N) 2 1 " cos ( 27r " wA ) 
. (2^) 2 4^ • Iff = i (4im t=1 , l^fcl 2 + |A,| 2 ) 5 • 4 _ 

- itXp-o) UU I min * 1 , lM*IW^)/N) 2 '"i'b : N 2 = 

and, finally, in 7g by 

(2vrLt/Aj) 2 4^A 2 *> • (min*=i,...,, |^| 2 /4 + |A,| 2 ) 



vr 2 (P-?) 8-9A 2 9n?=ilMiP 
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(2vrt) 2 4^ • n? =1 (min fc=1 ,..„ 9 |/. fc | 2 /4 + |A„ , _ 



This shows Eq. (A. 12) and thus concludes the proof. 
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